EXTENDED WEIGHT SEMIGROUPS 
OF AFFINE SPHERICAL HOMOGENEOUS SPACES 
OF NON-SIMPLE SEMISIMPLE ALGEBRAIC GROUPS 



ROMAN AVDEEV 

Abstract. The extended weight semigroup of a homogeneous space G/iJ of a connected 
semisimple algebraic group G characterizes the spectra of the representations of G on 
the spaces of regular sections of homogeneous linear bundles over G/H, including the 
space of regular functions on G/H. We compute the extended weight semigroups for 
all strictly irreducible affine spherical homogeneous spaces G/H^ where G is a simply 
connected non-simple semisimple complex algebraic group and H a connected closed 
subgroup of it. In all the cases we also find the highest weight functions corresponding 
to the indecomposable elements of this semigroup. Among other things, our results 
complete the computation of the weight semigroups for all strictly irreducible simply 
connected affine spherical homogeneous spaces of semisimple complex algebraic groups. 



1. Introduction 

1.1. Let G be a connected reductive algebraic group over C and H a closed subgroup 
of it. We consider the homogeneous space G/H and the algebra <C[G/H] = C[G]^ of 
regular functions on it. This algebra has the structure of a rational G- module with 
respect to the action of G by left multiplication and decomposes into a direct sum of 
finite-dimensional irreducible G-modules. A problem of interest is to find all A for which 
this decomposition contains the irreducible G-module Vx with highest weight A and to 
determine the multiplicity mx of Vx- Those dominant weights A of G satisfying nix ^ 1 
form a semigroup called the weight semigroup of the homogeneous space G/H. We denote 
this semigroup by T{G/H). 

The subgroup H (resp. the homogeneous space G/H, the pair {G,H)) is said to be 
spherical if a Borel subgroup B G G has an open orbit in G/H. The results of the 
paper |T], which are discussed in § ll.3l below. yield that for spherical homogeneous spaces 
the G-module C[G/H] is multiplicity free. (The converse is also true if G/H is quasi- 
affine.) By definition, this means that mx ^ 1 for every A. For semisimple G, the 
classification of affine spherical homogeneous spaces (that is, with reductive H) up to 
local isomorphism was obtained in |2]-|3]. Namely, all pairs {G,H) with G a simply 
connected simple algebraic group and H a connected reductive spherical subgroup of 
it are found in |i2] along with a description of the corresponding weight semigroup for 
every such pair. Up to local isomorphism, all affine spherical homogeneous spaces of 
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non-simple semisimple algebraic groups are classified in |3], [1] (see also [5] for a more 
accurate formulation). Every such space can be obtained by a certain procedure starting 
from strictly irreducible spherical homogeneous spaces. (Their definition will be given 
in § 11.41 ) Up to local isomorphism, these can be of the following three types: 

1) spherical spaces G/H, where G is simple (classified in [2j); 

2) spaces G/H, where G = H x H , the subgroup H is embedded in G diagonally, H is 
simple; 

3) spaces G/H corresponding to the pairs {G, H) in Table [1] below (classified in [3], [3]). 
The weight semigroups of all spaces of type 1) are computed in [2J. For spaces of 

type 2), the semigroups T(G/H) are well known, see § 11.41 The weight semigroups for all 
spaces of type 3) are computed in the present paper. 

More precisely, for each spherical homogeneous space in Table [T] we compute its ex- 
tended weight semigroup (to be precisely defined in § 11. 2p and the weight functions 
corresponding to the indecomposable elements of this semigroup. In particular, using 
these results one can easily compute the weight semigroups for the spaces in Table [1] 
Yu. V. Dzyadyk reported to E. B. Vinberg that he had computed the extended weight 
semigroups of all the homogeneous spaces appearing in Tabled] in 1985. He used another 
method going back to his papers [6J, ^ (see also [8j) dealing with the case of symmetric 
spaces. This method does not require explicit computation of weight functions. Unfortu- 
nately, the results of Dzyadyk have not been published hitherto. 



1.2. Throughout this paper the base field is the field C of complex numbers, all topological 
terms relate to the Zariski topology, all groups are supposed to be algebraic and their 
subgroups closed. For any group L let X(L) denote the group of its characters in additive 
notation. 

In what follows, we keep the notation G for a connected semisimple algebraic group. 
We suppose that a Borel subgroup B G G and a maximal torus T G B are fixed. The 
maximal unipotent subgroup of G contained in B is denoted by U. We identify the group 
X{B) with X(T) by restricting the characters from B to T. The set of dominant weights 
of B is denoted by X+{B). 

The actions of G on itself by left multiplication {{g,x) i— )■ gx) and right multiplication 
{{g,x) I— !■ xg~^) induce its representations on the space C[G] of all regular functions on 
G given by {gf){x) = f{g^^x) and {gf ){x) = f{xg), respectively. For short, we call them 
the left action and the right action respectively. For any subgroup L C G, we write '^C[G'] 
(resp. C[G]'^) for the algebra of functions in C[G] that are invariant under the left (resp. 
right) action of L. 

We now introduce the notion of the extended weight semigroup of a homogeneous space 
G/H. 

Let if C G be an arbitrary subgroup. For every character x £ X{H) we denote by 
the subspace of C[G] consisting of weight functions of weight x with respect to the right 
action of H, that is. 



V^ = {feC[G]:f{gh) = x{h)f{g) WgeG, WheH}. 
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Let Hq C G be the intersection of the kernels of all characters in X{H): Hq = f] Ker x- 

xmH) 

Then ^ ~ CfG]^". Since the left and right actions of G on C[G] commute, the 

subspace V"^ is invariant under the left action of G for any x ^ ^{H). 

We note that the quotient group H/Hq is commutative (that is, H/Hq is a quasi-torus) 
and the natural embedding X{H/Hq) X{H) is an isomorphism. 

Suppose that for each subspace V"^ its decomposition into a direct sum of irreducible 
G-modules is fixed. Then the highest weight vectors of all these G-modules taken over all 
X form a basis of the algebra (considered as a vector space over C) 

A = A{G/H) := ^(C[G]^°) = ^C[G]^o. 

Suppose / G v4 \ {0}, A G X+(T), and x ^ X{H). We say that / is a weight function 
with respect to B x H (or simply a weight function) of weight (A, x) (in the case X{H) = 
we simply write A instead of (A,0)), if / is the highest weight vector of an irreducible 
G-module N G with highest weight A. We denote by Ax^-^ the subspace of A consisting 
of zero and all weight functions of weight (A,x)- If fi ^ ^\i,xi ^ ^M,X2^ then 

/1/2 € ^Ai+A2,xi+X2- Thus the set of pairs (A,x) with A G X_|_(i?), x ^ ^{H), and 
^A,x 7^ is a semigroup. We call this semigroup the extended weight semigroup (the term 
is suggested by Vinberg) of the homogeneous space G/H and denote it by T{G/H). 

Remark 1. We have T{G/H) = {(A, x) e f{G/H) : ^ = 0} C f{G/H). Clearly, X{H) = 
implies that T{G/H) = V{G/H). 

Remark 2. The map vr: T{G/H) — t- T{G/Hq), (A,x) ^ A, is surjective, and 7r~^(0) = 
{(0,0)}. 

Remark 3. There is another interpretation of the semigroup T{G/H) in the case when 
H is connected. Namely, consider the group G = G x [H/Hq) and its subgroup H H 
embedded in G via h [h, hHo). The algebra C[G']''^" is a G-module with respect to the 
left action of G and the right action of H/Hq. Consider the algebra C[G']^ as a G-module 
with respect to the left action of G. The map i): €.[G]" C[G]-^«, i^f)ig) = f{g,eHo), 
is an isomorphism of G-modules. (The inverse map F 1— > F is given by F{g, hHo) = 
F[gh~^).) Therefore there is a semigroup isomorphism T{G/H) ~ T{G/ H). 

1.3. Now suppose that if C G is a spherical subgroup. According to Theorem 1 of [1], 
this implies that the representation of G on is multiplicity free for each % G X{H). 
Hence, any pair (A, x) ^ T{G/H) determines a unique, up to multiplication by a non-zero 
constant, weight function / G Ax_^; that is, dimAx^^ = 1. 
Let us prove the following fact. (Cf. [9], Proposition 2.) 

Theorem 1. Suppose G is simply connected and H G G is a connected spherical subgroup. 
Then the algebra A is factorial and the semigroup T[G/H) is free. 

To prove Theorem [H we need the following 

Theorem 2 (p^. Theorem 3.17). Suppose a regular action of an algebraic group L on an 
affine variety X is given. If the algebra C[X] is factorial and L is connected and has no 
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non-trivial characters, then the algebra C[X]^ is also factorial. Moreover, for any element 
f G C[X]^ all its divisors in C[X] are contained in C[X]^ . 

Proof of TheoremUi Since G is simply connected, the algebra C[G] is factorial (see 
Corollary from Proposition 1). Let H = Hu X i? be a Levi decomposition of H , where 
Hu (resp. R) is the unipotent radical (resp. a maximal reductive subgroup) of H . Then 
Hq = Hu X [R, R] where [R, R] is the derived subgroup of R. Since H is connected, 
it follows that R is also connected, whence the group [R, R] is either connected and 
semisimple or trivial. Therefore Hq is connected and has no non-trivial characters, so 
the group U x Hq also possesses these properties. Hence one can apply Theorem [2] to 
the action of U x Hq on G, where U and Hq act on G by left and right multiplication, 
respectively. Thus the algebra A is factorial. Let {/ij} be the set of all indecomposable 
elements of T{G/H). As mentioned above, the sphericity of H implies that for every 
element /ij there is a unique, up to multiplication by a non-zero constant, weight function 
/j G A of weight /ij. Moreover, fi is an irreducible element of A. Assume that there is a 
non-trivial relation fcj/ij = Ij^j for some integers fcj, Ij > 0. It implies the relation 

^rij fi' ~ Ylj fj f*^^ some c G C^, which contradicts the factoriality of A. □ 

1.4. A direct product of spherical homogeneous spaces 

(Gi/iJi) X {G2/H2) = (Gi X G2)/{H^ X H2) 

is again a spherical homogeneous space. Spaces of this kind, as well as spaces locally 
isomorphic to them are called reducible, all others are said to be irreducible. A spherical 
space G/H is said to be strictly irreducible if the spherical space G/N{H)^ is irreducible, 
see [12], L3.6. (Here N{H)^ is the connected component of the identity of the normalizer 
of H in G.) 

We now formulate the main results of this paper. First, we compute the semigroups 
V[G/H) for all strictly irreducible spherical pairs {G,H), where G is a simply connected 
non-simple semisimple algebraic group, H its connected reductive subgroup. All such pairs 
except for symmetric pairs, which are to be discussed later, are listed in Table [TJ The 
indecomposable elements of the corresponding extended weight semigroups are indicated 
in the column T(G/if)' of Table [1] Second, for each space G/H m. Table [1] we find the 
weight functions in A that correspond to the indecomposable elements of T{G/ H). These 
functions freely generate the algebra A. 

Having known the semigroups T{G/ H) for the spaces in Tableland taking into account 
Remark [H one can obtain a description of the semigroups T{G/H) for these spaces. 
In particular, f{G/H) = T{G/H) for spaces 2, 4-8 in Tabled 

Every simply connected strictly irreducible spherical homogeneous space of a non-simple 
semisimple algebraic group G that is symmetric is isomorphic to one of the spaces of the 
form X{H) = {H x H)/H (the subgroup H is embedded diagonally), where H is simple 
and simply connected. For spherical homogeneous spaces of this kind, the structure of the 
semigroup r{X{H)) = r{X{H)) is well known and follows, for instance, from Theorem |5] 
(see § 12.11 below) with L = K = H. Namely, this semigroup is freely generated by the 
elements VTj + i = 1, . . . , rkif, where VTj and (fi are the fundamental weights of the first 
and second factors oi H x H, respectively. The asterisk denotes the highest weight of the 
dual representation. 
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Table 1. 





~^ H 
\j _j n 


Embedding 
diagram 


IKi 1 ll J 




iNote 


1 


SL„ X SL„+i D SL„ xC^ 



I/I 

• • 


2n 


if 1,1^x0), 
(7r„_i+v?2, (n-l)xo), 

. . . , (7ri+(^„,Xo), 
(7r„_i+.^i,-Xo),---, 

(7ri+(^„_i, -(n-l)xo), 


n ^ 2 


2 


Spin„ X Spin„+i D Spin„ 




\/ 

• 


n 


Ifl+(P2, TTl+lfl, Tri+ip2 

for n = 3 

TT2+(P2, ■ ■■ , T^k-2+Vk-l; 
T^k-l+Vk: T^k+fk 

for n = 2k 

ipi, TTl+ipi, 7ri+(p2, 
TT2+'P2, ■ ■■ , Trfc-l+i^fc-l, 
T^k-l+V^k+^Pk+l, 
Trk+(pk, T^k+fk+l 

for n^2k + 1^5 


n ^ 3 


3 


SL„ X Sp2„j 

DCX-SL„_2XSL2XSp2,„_2 




/l\/\ 

• • • • 


6* 


(7r„_2,2xo), 
(¥^2,0) (m>2), 

(7r„_i+^i,Xo), 
(7ri+7r„_i,0) (n^4), 

(7ri+(^i,-Xo), 
(7r2,-2xo) 


n ^ 3 
m 5^ 1 


4 


D SL„_2 X SL2 X Sp2„i_2 




/\/\ 

• • • 


6* 


7r„-2, </?2 {m^2), 

7r,i-l+ly9l, TTl+TTn-l, 
TTl+<fil, TT2 


77, 5 

m 5^ 1 


5 


Sp2n X Sp2m 

^ ^P2n-2 X Sp2 X Sp2„i_2 




/\/\ 

• • • 


3* 


112 ("^2), (^2 (m^2), 


n ^ 1 
m ^ 1 


6 


SP2„ X Sp4 D Sp2„_4 X Sp4 




l\l 

• • 


6* 


7ri+(y9l, 7r2+</92, 

7r3+(^i, TTi (n^4), 
7r2, 7ri+7r3+(/52 


n ^ 3 


7 


Sp2n X Sp2m X Sp2; 

3Sp2„„2X Sp2,„_2X Sp2;_2X Sp2 


/I\ 

000 
• • • 


6* 


7r2 (ri>2), (/32 (m>2), 
-02 (^^2), 7ri+(pi, 


n ^ 1 
m ^ 1 
/ ^ 1 


8 


Sp2„ X Sp4 X Sp2„j 

^ Sp2„_2 X Sp2 X Sp2 X Sp2„_2 


000 

/\/\/\ 

• • • • 


6* 


7r2 (n^2), 02 (to^2), 

7ri+(/32+V'i 


n ^ 1 
m 5^ 1 



For computation of the extended weight semigroups, two different approaches are used 
in this paper. The first one is apphed to spaces 1 and 2 in Table [H and the second to all 
the others. 
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The paper is organized as follows. In §|2] we formulate and prove all the statements 
needed for our approaches for computation of the extended weight semigroups. In §12] we 
compute the semigroups T{G/H) for each of the homogeneous spaces G/H appearing in 
Table [1] We also find the weight functions in A corresponding to the indecomposable 
elements of the respective semigroups T{G/H). 

Let us explain the notation used in Table [TJ The first two columns of this table are 
taken from Table 2 in [12] but are represented in a form which is more convenient for our 
purpose. The dot between the first and the second factor of H in row 3 denotes their 
almost direct product, that is, these two factors have a non-trivial (but finite) intersection. 

The embedding diagram describes the embedding of if in G and ought to be interpreted 
as follows. The white nodes correspond to the factors of the group G and the black ones 
to those of H . The order of nodes is the same as that of the corresponding factors, except 
for no. 7 where the upper black node corresponds to the last factor of H . The factor of H 
corresponding to a black node v is diagonally embedded in the product of the factors of G 
that correspond to the white nodes joined with v. 

The column 'rkr(G'/if)' shows the rank of the semigroup r{G/H), that is, the number 
of indecomposable elements of T{G/H). In this column, an asterisk stands for the cases 
when, for several small values of the parameters n, m, /, the rank of the extended weight 
semigroup of the corresponding homogeneous space is less than the value indicated in the 
table. The exact value of the rank for given values of the parameters can be determined 
using the information in the column ^r{G/H)\ 

The column T(G'//7)' contains a list of all indecomposable elements (A, x) of the semi- 
group r{G/H). (If X{H) = 0, then we write simply A instead of (A,0).) These elements 
freely generate it. If {G,H) is a pair in Table [1] with X{H) ^ 0, then H/Hq is a one- 
dimensional torus. Each character x ^ X{H) is identified with some character of this torus 
and, therefore, the characters of H are written in the column T(G/iJ)' as multiples of 
the character Xo^ where Xo is a fixed basis character of H/Hq. In each case, an explicit ex- 
pression for Xo can be found in §[3l Whenever an element (A, x) is followed by parenthesis 
containing an inequality for one of the parameters ra, m, /, the weight (A, x) is contained in 
the set of indecomposable elements of T(G/ H) if and only if the corresponding parameter 
satisfies that inequality. 

Some notation and conventions 

If the group G (resp. Hq) is a product of several factors, then the z-th factor is denoted 
by Gi (resp. Hi). We write f/j, and Tj respectively for the Borel subgroup, the maximal 
unipotent subgroup, and the maximal torus of Gi such that B = Yl^i^ ^ = 11^*' ^"^^ 
T = Y\Ti. By TTj, yjj, and ipi we denote the z-th fundamental weight of the first, the 
second, and the third factor of G, respectively. 

Our numeration of fundamental weights of simply connected simple algebraic groups is 
the same as in the book |13] . 

For every semisimple group L, we denote by V\{L) the irreducible L-module with highest 
weight A. The weight dual to the weight A is denoted by A*. 

The identity element of any group is denoted by e. 

By we denote the multiplicative group of the field C. 



EXTENDED WEIGHT SEMIGROUPS 



7 



If P is a matrix, then the equation P = (pij) means that Pij is the element in the i-th 
row and the j-th column of P. 

Given elements ai, . . . , a„ of a group, we write S{ai, , a„) (resp. ( )) for 

the subsemigroup with identity (resp. the subgroup) generated by 

We denote by En the identity matrix of order n and by F„ the matrix of order n with 
ones on the antidiagonal and zeros elsewhere. 

The basis ei, . . . , of the space of the tautological linear representation of the group 
Sp2m is supposed to be chosen in such a way that the matrix of the invariant non- 
degenerate skew-symmetric bilinear form U2m is 




With this choice of the basis, the Borel subgroup and the maximal unipotent subgroup 
of Sp2m are represented by upper-triangular matrices. 



2. Auxiliary results 

2.1. Theorems [3H5] are used to compute the extended weight semigroups of spaces 1 and 2 
in Tabled! Theorems [2111] describe known branching rules for the groups SLn+i, Spin„_,_]^, 
respectively (see original papers [H], pL5j or a modern exposition in JTU\) stated in a form 
which is convenient for our purpose. 

Theorem 3 (branching rule for the group SL„_|_i). Suppose A = CiTTi + -|- c„7r„ 

is a dominant weight of SL„+i, where q ^ 0. Then the restriction of the irreducible 
representation of SL^+i with highest weight A to the subgroup SL„ C SL„_|_i has the form 
^ V^(SL„), where the set M(A) consists of dominant weights fi of SL„ {possibly with 

multiplicities) that can be obtained from A by simultaneously replacing all summand of 
the form CiiTi by aiiTi^i + biTTi, where ai, bi ^ and ai + bi = Ci. At that, we put ttq = 
and TT^L. =0. 

Before we formulate the next theorem, let us note that every dominant weight A of the 

group Spin2fc_,_2 is uniquely expressible in the form A = CiTTi + + Ck+iTCk+i + d{nk + 

TTfc+i), where Cj, d ^ and at least one of the numbers c^, c^+i is zero. 

Theorem 4 (branching rules for the group Spin„_^]^). a) Suppose A = CiTTi -|- -|- CfcTTfc 

is a dominant weight of Spin2fc+i, k ^ 2, where q ^ 0. Then the restriction of the 
irreducible representation of Spiug^^.^ with highest weight A to the subgroup Spin2fc has 
the form V"^(Spin2fc), where the set M{X) consists of dominant weights ^ o/Spin2fc 

that can be obtained from A by simultaneously replacing all summands of the form CiiTi 
(fori^k — l) by aiiTi^i + biTTi and the summand Ck-iTTk-i by ak~i'T^k-2 + bk~i{Tik~i + T^k), 
where ai,bi and ai + bi = Ci. At that, we put tto = 0. 

b) Suppose A = CiTTi + • — h Ck+iiTk+i + dij^k + T^k+i) is a dominant weight of Spin2fc_,_2j, 
^ 1, where Ci,d ^ and at least one of the numbers Ck, Ck+i is zero. Then the restriction 
of the irreducible representation of Spin2,fc_|_2 with highest weight A to the subgroup Spin2fc_,_;^ 
has the form ^ V^(Spin2^_,_i), where the set M(A) consists of dominant weights ^ of 

Spin2fc_,_;L that can be obtained from A by simultaneously replacing all summands of the 
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form CiiTi {for i < k) by aiiTi^i + fejVTj, where ai, &j ^ and ai + hi = Ci, all summands of 
the form CiiTi {for i = k,k + 1) by CiiTk, and the summand d{TXk + T^k+i) by ank-i + 26??^, 
where a,b ^ and a + b = d. At that, we put ttq = 0. 

Theorem 5. Suppose L, K are connected semisimple algebraic groups and L G K. Let 
mx^n be the multiplicity with which the irreducible representation of L with highest weight n 
occurs in the irreducible representation of K with highest weight A. Consider the group 
G = L X K and its subgroup H c:^ L embedded in G diagonally. Then there is an isomor- 
phism of G -modules C[G]^ ~ "^a./^V'^+a* (C) {G acts on C[G]^ by left multiplication), 

where X, /i run over all dominant weights of K , L, respectively. 

Proof. Consider the space C[K] as a G-module on which L and K act by left and right mul- 
tiplication respectively. There is an isomorphism of algebras and G-modules C[(j]^ — 
C[X] given by {(pf){x) = f{e,x). Further, it is well-known that the space C[i^], regarded 
as a {K X iir)-module with respect to the actions by left and right multiplication, is iso- 
morphic to the direct sum ^Vx{K)* V\{K), where A runs over all dominant weights 

A 

of K. Restricting the action of K by right multiplication to L and taking into account 
the relations Vx{Ky ~ Vx^K) and Vx^K) ® V^{L) ^ Vx*+^,{K x L) ~ V^+x'{G), we get 
the desired result. □ 



2.2. The results in this subsection are used for computation of the extended weight semi- 
groups of spaces 3-8 in Table [1] 

Lemma 1. Suppose a group L acts on an irreducible algebraic variety X . Suppose there is 
a closed subset Y G X , which is called a section, and an open subset M G X such that the 
orbit of any point in M meets Y . Then the restriction homomorphism p: <C[X]^ — C[Y] 
is infective. 

Proof. Assume that p{f) = for some function / G C[X]^. satisfies . Then /|^^ = 
because invariant functions are constant along orbits. This implies / = 0. □ 

Theorem 6. Suppose the group Sp2m-2k! k ^ 1, is embedded in Sp2m ^he central 
{2m — 2k) X (2m — 2k) block and acts on Sp2m right multiplication. Then the algebra 
of invariants of this action coincides with the subalgebra of the algebra CfSpg^] generated 
by the matrix entries of the first k and last k columns. 

Proof. Let V be the space of the tautological representation of Sp2,„- Consider the natural 
action of Sp2m '^'^ ^^e space 

= y ® ■ ■ ■ev e j/® 

k k 

The subgroup Sp2m-2k ^^e hypothesis of the theorem is the stabilizer of the vector 
w = (ei, 62, ... , Cfc, e2m-fc+i, e2m-fc+2, • • • , e2m) uudcr this action. The orbit of w in W 
is isomorphic to the quotient space Sp2m / Sp2m-2fc ^^^d this isomorphism induces the 
correspondence between regular functions on this orbit and the required invariants. The 
orbit is closed since it consists of the sets of vectors {vi,V2, ■ ■ ■ ,V2k) whose Gram matrix 
with respect to the form U2m is ^2k- Hence, the algebra of regular functions on the 
orbit is generated by the restrictions of the coordinates of the ambient space W. These 
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coordinates correspond to the matrix entries of the first k and the last k columns of a 



matrix in Sp 



2m- 



□ 



The next three lemmas are technical. The proofs of the first two of them are obtained 
by direct computation. 

Lemma 2. For every non- degenerate matrix P of order m, the matrix 

(1) (o (p°i)# 

of order 2m is symplectic. {Here the symbol 7^ denotes the transpose of a matrix with 
respect to the antidiagonal.) 



Lemma 3. The matrix 
(2) 



Efn 





c 

Ern 



of order 2m is symplectic if and only if the matrix C of order m is symmetric with respect 
to the antidiagonal. 



Then there are upper 



Lemma 4. Let P = {pij) he a 2m x 2 matrix, m ~^ 2, and Pi, P2 its first and second 
columns, respectively. Suppose p2m,i 7^ 0, A = P2m-i,iP2m,2 - P2m-i,2P2m,i 7^ 0, and 
Pi^2m.P2 = 1 {the symbol T denotes the transposed matrix), 
unitriangular matrices ui,U2 G Sp2m ^"^^^ that 

( 





1 \ 




1 


\ 


P2m.\ 




P2m,l 










A 




U2P = 




A 


A 





P2m.\ 




P2m,l 


P2m,2 1 




\ P2m,l 


P2m,2 ) 





V P2m,l 

{The dots stand for zero entries.) 

Proof. Multiplying P on the left by an appropriate upper unitriangular matrix of type ([Tj), 
we obtain a matrix P' whose lower half contains only three non- zero elements: P2m,i, P2m,2, 
and —A/p2m,i (as in the matrices UiP and U2P appearing in the assertion of the lemma). 
Then, multiplying P' on the left by an appropriate matrix of type ([2]), we obtain one of 
the required matrices. □ 

The following theorem is used at the final stage of the argument in all cases. 

Theorem 7. Suppose G is simply connected and H G G is a connected spherical subgroup. 
Suppose non-zero functions /i, ...,/„ G A satisfy the following conditions: 

a) fi G ^Ai,xi /^'^ ^ = l,...,n, where Aj G X+(i?), Xi ^ ^{H), and the weights 
(Ai, Xi)i ■ ■ ■ 1 {^ni Xn) o-re linearly independent; 

b) there is an inclusion A C C[/i, ...,/„, f^^, . . . , ff^-^] for some k ^ n. 

Put Z = ((Ai,xi), • • • , (Afe,Xfc)) + 5'((Afc+i,Xfc+i), • • • , (A„,Xn))- Then: 
1) if for each expression 

(3) (Ai,Xi) = (/ii,cri) + (/i2,cr2), /ii,/i2 G X+(P) \ {0}, 0-1,0-2 G 
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at least one of the weights (/ii,(Ti), {^^2,0-2) is not contained in Z, then the element fi is 
irreducible in A; 

2) if (Aj, Xi) = (Aj, Xj) + (Aj, — Aj, Xi ~ Xj); i 7^ 3 1 is the unique expression of the weight 
(Ai,Xi) in the form ([2]) such that both summands belong to Z, and if fi is not divisible 
by fj in A, then the element fi is irreducible in A; 

3) if fi is irreducible in A for i = 1, . . . ,n, then A = C[/i, ...,/„] and T{G/H) = 
S{{Xi,Xi), (A„,Xn))- 

Proof. Let us prove 1), 2). Assume that fi is reducible in A. Then fi = F1F2 where 
for j = 1,2 the element Fj G A is not invertible and Fj G A^.^r^. for some C,j G X+{B), 
r]j G X{H). We have C,j 7^ 0, j = 1,2, because otherwise Fj would be a constant. It 
follows from b) that each of the functions Fi, F2 is expressible as an irreducible fraction 
of the form 

^ _ hj{fi, . . . , fn) 
Jl " ' Jk 

where Pji,...,Pjk ^ and hj are polynomials in n variables. Using a), we obtain 
hjifi, ■■■,fn) = Cjf"'^ ■ ■ ■ fn'", where Cj 7^ and aji, ...,ajn ^ 0. Then (/i^, aj) G Z 
for j = 1,2. In the hypothesis of 1), we have already come to a contradiction. In the 
hypothesis of 2), we see that one of the functions Fi, F2 has weight {Xj, Xj) and, therefore, 
is proportional to fj since dim Ax. = 1. Thus, /, is divisible by fj, a contradiction. 
We now prove 3). Suppose / G Ax^^. for some A G X+(-B), x ^ X{H). Arguing as in the 

proof of 1), we see that / is expressible as an irreducible fraction of the form p^ ' 0^. , 

/i ■■■/fe 

where /3i, . . . , ^ and ai, . . . , a„ ^ 0. Since A is factorial (Theorem [1]) and all the 
elements fi are irreducible, it follows that the numerator of this fraction is divisible by its 
denominator, whence /3i = ■ ■ ■ = = 0. Therefore, / = /"^ ■ ■ ■ and we obtain the 
required result. □ 

3. Computation of the extended weight semigroups 

In this section, the cases are numbered in accordance with the numbers in Table [TJ 
Except in Case 2 we use the following convention. For each factor Gi G G (all of them 
are of type SL or Sp), the subgroups Bi, Ui, and Tj consist of all upper triangular, upper 
unitriangular, and diagonal matrices, respectively, contained in Gi. 

3.1. At first, we compute the semigroups T{G/H) for spaces 1, 2 in Tabled] 

Case 1. G = SL„ x SL„_|_i, H = SL„ xC^ , H being embedded in G in such a way that 
the image in G of a pair (P, t) G H is the pair (P, P') C G, where P' = Lp{P,t) = ( ^ °„ ) . 
Further, Hq = SL„x{e} C H. The basis character xo ^ X(if) takes each element 
(P, t) eH to t. 

Let us present 2n functions in A that are weight functions with respect to B xH. Given 
(P, Q) G G, we put R = QP~^, where P = (f{P, e). We denote by Aj, i = 1, . . . ,n, the 
minor of R corresponding to the last i rows and first i columns, and hj 6i, i = 1, . . . ,n, 
the minor of R corresponding to the last i rows and columns n + l,l,2,...,2 — 1. The 2n 
functions Ai, . . . , A„, 61, . . . ,6n all belong to A and are weight functions with respect to 
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B X H. The weights of Ai, A2, . . . , A„_i, A„ are 

(tti + V5„,Xo), (7r2 + v3n-i,2xo), (7r„_i + - l)xo), i(pi,nxo), 

respectively, the weights oi 61,62,63, ... ,6n are 

{ipn,-nxo), (vTi + V2n-i, -(n - l)xo), {^2 + ipn-2, -{n - 2)xo) , (7r„_i + yJi , "Xo) , 

respectively. Moreover, the 2n weights of the functions Ai, . . . , A„, 6i, . . . ,6n are linearly 
independent, whence Tkr{G/H) ^ 2n. Since rkG = 2n — 1 and ik H/Hq = 1, it follows 
that vkf (G/H) ^ 2n. Hence rkf{G/H) = 2n. 

Applying Theorem [5] for L = SL„, K = SL„+i and using Theorem [3l we determine 
the spectrum of the representation of G on the space C[G]^°. (Thereby we determine 
the semigroup T^G/Hq).) In particular, we obtain the following two facts. First, this 
spectrum contains the irreducible G-modules with highest weights 

[2n weights in total), each of multiplicity 1. Second, any non-zero weight in T{G/Hq) 
contains at least one summand of the form ipi. It follows that each of the weights ^ is 
indecomposable in T{G/Hq). We note that the set of 2n weights (jl]) is the image under 
the map vr (see Remark [2]) of the set of 2n weights with respect to B x H that corre- 
spond to the functions Ai, . . . , A„, 6i, . . . ,6n- Hence, by Remark [21 the latter 2n weights 
are indecomposable in T(G/H). Since ikT{G/H) = 2n, it follows that the semigroup 
T{G/ H), which is free, is generated by the weights with respect to B x H oi the functions 
Ai, . . . , A„, 5i, . . . , 6n. Therefore A = C[Ai, . . . , A^, 6i, . . . , 6n\. 

Case 2. G = Spin„ x Spin„^_]^, H = Hq = Spin„. Since X{H) = 0, we get V{G/H) = 
r{G/H) and a description of the semigroup T{G/ H) follows from Theorems [5l HI Namely, 
a direct check shows that, for each n ^ 3, the weights in the column T(G/if)' of Ta- 
bled] (there are exactly n of them) lie in the semigroup T{G/H) and linearly indepen- 
dent, therefore ikT{G/H) ^ n. Since ikT{G/H) ^ rkG = n, we get ikT{G/H) = n. 
Further, it is easy to see that every non-zero element of T{G/H) contains one of the 
elements ipi as a summand, whence all these weights are indecomposable except for the 
weight Tik-i + V'fc + ^k+i for n = 2k + 1. The last weight is indecomposable in T{G/H) 
because none of the weights ^9^, ^pk+i is contained in T{G/H). Thus, for each n ^ 3 
we have found n indecomposable linearly independent weights in the semigroup T{G/H). 
Since ikT{G/H) = n, these n weights freely generate the semigroup. 

We now present weight functions generating the algebra A{G'/H') where G'/H' is a 
homogeneous space locally isomorphic to G/H. Namely, we consider the group G' = 
SOn X SO„+i and its subgroup H' = S0„ embedded in G' diagonally. The covering 
homomorphism of groups i/j: G ^ G' induces the morphism ipH'- G/H — > G'/H', which 
is a two-sheeted covering. Therefore there is an embedding of algebras 

rH--C[G'/H']^C[G/H], 

at that, ij*H{A{G'/H')) c A{G/H). 

For each m we choose a basis {cj} in the space Vm of the tautological representa- 
tion of SOm such that the matrix of the invariant non-degenerate symmetric bilinear form 
is Fm. Then all upper-triangular and diagonal matrices in SO^n form a Borel subgroup Bm 
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and a maximal torus T^, respectively. We shall consider weights of irreducible representa- 
tions of SOm with respect to Bm and T^. We fix the embedding : SO^ ^ SOm+i such 
that its image is the stabilizer of the vector eHi_i_i for even m and the vector e 
for odd m. 

We fix the embedding H' in G' sending every matrix P E H' to {P,Tn{P))- Suppose 
{P,Q) G G' and put R = QTn{P)~^. Now we present the generators of A{G'/H') for 
each n. 

If n = 2k, then we consider the following functions on R: Aj, i = l,...,k, is the 
minor corresponding to the last i rows and first i columns; 6i, i = 1, . . . ,k, is the minor 
corresponding to the last i rows and columns k+1, 1, . . . , "i— 1; $ is the minor corresponding 
to the last k rows and columns k+2, 1, . . . , k—1. We have 5| = — 2Ajfc$. All these functions 
are weight functions with respect to x x H' and generate A{G' /H'). The weight 

of Aj is 7Ci + ifi foT i ^ k — 2, nk-i + T^k + Vk-i ioT i = k — 1, and 2(7?^ + ifk) for i = k. 
The weight of 6i is TTj-i + for z ^ A; — 1 (we put ttq = 0) and TCk-i + 7Ck + 2ipk for 
i = k. The weight of $ is 2(7rfc_i + (y^fc). The algebra A{G/H) also contains functions A 
and D such that A^ = ij^iAk), D'^ = and AD = Their weights are 

7ik + (pk and TTk-i + (fk, respectively. The functions ip^{Ai) and ipni^j)^ hj ^ k — 1, along 
with the functions A and D correspond to the indecomposable elements of T{G/H) and 
generate A{G/H). 

If n = 2fc + 1, then we consider the following functions on R: Aj, i = 1, . . . ,k, is 
the minor corresponding to the last i rows and first i columns; 6i, i = 1, . . . , k + 1, 
is the difference of two minors, the first corresponding to the last i rows and columns 
k + 1,1, ... ,i — 1, and the second corresponding to the last i rows and columns k + 
2, 1, . . . , i — 1; $ is the minor corresponding to rows 1, . . . , k, k + 2 (counting from the 
bottom) and columns 1, . . . , fc, 2 [|] +2. We have A| = (—1)^+^5^+1$. All these functions 
are weight functions with respect to (i?„ x Bn+i) x H' and generate A{G' /H'). The weight 
of Aj is TTi + (fi foT i ^ k — 1 and 2TTk + fk + fk+i for i = k. The weight of 6i is VTj-i + (fi 
for i ^ k — 1, TXk-i + V^fc + V'fc+i for i = k, and 2(7?^ + fk+i) for i = k + 1 (we put ttq = 0). 
The weight of $ is 2{nk + ifk)- The algebra A{G/H) also contains functions 6 and D such 
that 5^ = ?/'|^(4+i), = ^/>|^($), and ^(-l)fc+i5L) = A^. Their weights are tt^ + v^fc+i 
and TTfc + (fk, respectively. The functions tp^{Ai), i ^ k — 1, ipniSj), j ^ k, 6, and D 
correspond to the indecomposable elements of V{G/ H) and generate A{G /H). 

3.2. We now proceed to computing the extended weight semigroups of spaces 3-8 in 
Table [1] First we describe the general method. 

In each of the cases considered below we search for the algebra A. The functions in this 
algebra satisfy f{g) = f{u~^gh) for all (? G G, m G f/, /i G Hq. To find such functions, 
we multiply an arbitrary element g of some dense open subset M C G by appropriate 
elements in U and Hq so as to obtain an element of 'canonical' form. A canonical form 
for elements of M is specified by the condition that some of the matrix entries equal zero, 
some others equal one, and some of the remaining entries equal minus one. The set Y of 
elements of the whole group G (not only in M) satisfying these restrictions is closed in G 
and serves as a section in the sense of Lemma [1] By that lemma, A is contained in the 
algebra C[Y]. 
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In all the cases we first present a set of functions fi, . . . , fp G A that are weight func- 
tions with respect to B x H and then we use the canonical form to prove that these 
functions generate A. (In almost all cases the functions fi,...,fp naturally arise when 
reducing to canonical form.) The set M is determined by the condition that some of the 
functions fi, . . . , fp do not vanish. 

If one of the factors of G is Sp2m one of the factors of Hq is Sp2m-2k embedded only 
in Sp2m (^s the central (2m — 2k) x (2m — 2k) block), then by Theorem [6] every function 
in A is independent of the matrix entries of the factor Spg^ located in columns 

k + 1, k + 2, 2m-k-l, 2m - k. 

Therefore, when reducing to canonical form we may care not about transformations of 
these entries under the actions of U and Hq. In this connection, firstly, we do not consider 
anymore the action of the factor Sp2„i_2fc ^ -^o since it transforms in a non-trivial way 
only columns of Spg^ mentioned above. Secondly, it is sufficient for our purpose to reduce 
to canonical form not the whole of a matrix in Spg^ but only its first k and last k columns. 
In other words, it suffices to impose restrictions of the form = c, where c G {0, 1, — 1}, 
defining a canonical form of a matrix in Sp2m only on the matrix entries of the factor 
Sp2m ^hat are located in the 2k columns indicated above. Therefore, when formally 
considering matrices Q G Sp2m; we actually deal only with their submatrices Q consisting 
of the first k and the last k columns of Q, and it is Q that is reduced to canonical form. 
This can be interpreted as follows: the factor Sp2„i of G is replaced by the quotient space 
SP2m / Sp2m-2fc '^^ which the actions of U and the remaining factors of Hq are preserved. 
As we see from the proof of Theorem [6l this quotient space can be thought of as the set 
of 2m X 2k matrices whose columns satisfy the same relations as the first k and the last k 
columns of a matrix in Sp2m- 

It always turns out that the matrix entries of the canonical form of an element g & M 
on which the functions in A can depend are rational functions (more precisely, Laurent 
polynomials) in the values of fi, . . . , fp at the point g. We denote these rational func- 
tions, which are obviously invariant with respect to U and Hq, by ri(/i, . . . , /p), 
rq(/i, . . . , fp). Since regular functions on the section are generated by the restrictions of 
the coordinate functions on G, it follows that every function / G A is a polynomial in the 
functions ri, . . . , r^, that is, 

f{g) = F{nUM. • • • , Ug)). • • • , r,UM. • • • , Ug))) 

for every g G M, where F( polynomial. Thus, there is an inclusion A C 

i = C[ri(/i,..., /,),..., r,(/i,...,/,)]. 

Since the algebra A consists of rational functions that are invariant under U and Hq, it 
follows that A = An C[G]. Therefore our next step aims at extracting regular functions 
from A. This is carried out using Theorem [71 Namely, it follows from assertions 1) and 2) 
(the latter one is used only in Case 3 for n = 3 and Case 8) of Theorem [7] that each of the 
functions fi, ■ ■ ■ , fp is irreducible in A. Then assertion 3) yields that A = C[/i, . . . , /p]. 
A description of the semigroup T{G/H) also follows from assertion 3) of Theorem [71 

In all the cases the conditions a) and b) of Theorem [71 are verified directly, therefore we 
do not even mention that except in Cases 3, 4. We check the hypothesis of assertion 1) 
of this theorem only in Cases 3, 4 since it is verified similarly in all the remaining cases. 
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We now proceed to consideration of all the cases. Our argument follows the plan 
discussed above, which is therefore used without extra explanation. 

Cases 3, 4. It is convenient to consider the pairs in rows 3, 4 of Table [T] together. In 
both cases, G = SL„ x Sp2m, in Case 3 we have H = ■ SL„_2 x SL2 x Sp2m-2^ Case 4 
we have H = SL„_2 x SL2 x Sp2m-2- Case 4 is considered only for n ^ 5, otherwise the 
space G/H is not spherical. The embedding of if in G is as follows. The factor SL„_2 is 
embedded in the factor SL„ of G as the upper left {n — 2) x [n — 2) block. The factor 
SL2 is diagonally embedded in G as the lower right 2x2 block in SL„ and as the 2x2 
block corresponding to the first and last rows and columns of the factor Spg^. The factor 
SP2m-2 is embedded in Spg^ as the central (2m — 2) x (2m — 2) block. In Case 3 the torus 
C C if is embedded in SL„ as i?„_2t~^ © i?2t""^ for odd n and as En-2t~^ ® E2t^ 
for even n. The group Hq is the same in both cases and equals SL„_2 x SL2 x Sp2m_,2- 
In Case 3 the basis character xo ^ X(ii) acts on the torus G H as t ^-^ for odd n 
and as t I— )■ t 2 tor even n. 

We search for functions / G CfG] satisfying 

for all P G Gi, Q G G2, Ui G Ui, U2 G U2, hi G Hi, i = 1,2,3. Suppose P = (pij) and 
Q = {qij). We denote by Pij the (i, j)-cofactor of P so that P~^ = {Pji). 

Theorem [6] allows us not to consider the action of and to reduce to canonical form 
the first and last columns of Q. 

Suppose A = Pn-l,n-lPn,n — Pn-l,nPn,n-l, W = 5'2m-l,l'?2m,2m — '?2m-l,2m'?2m,l , D = 

,n-l + Pn,nPl,n) ^2 — Q2m,lPl,n-l + Q2m,,2mPl,n) ^ IS 

the minor of P corresponding to the last n — 2 rows and the first n — 2 columns. We 
have A, W, D, $1, $2, 6 e A. At that, = 1 for m = 1 and $1 = -6A for n = 3. All 
these functions are weight functions with respect to B x H. Their weights are listed in 
Table H 



Table 2. 



No. 


A 


W 


D 


*i 


$2 


6 


3 


(7r„_2,2xo) 


(^2,0) (m>2) 


(7r„_i+(/9i,Xo) 


(7ri+7r„_i,0) 


(tTi +(/?!, -Xo) 


(7^2,-2x0) 


4 




(/32 [m ^ 2) 


7r„-i+((5i 


7ri+7r„_i 


TTi+ifi 


7r2 



Below we shall apply Theorem[7]to the functions A, W (the latter is present for m ^ 2), 
D, $1, $2, S for n ^ 4 {in Cases 3, 4) and the functions A, W (the latter is present for 
m ^ 2), D, ^2, S for n = 3 (in Case 3). We note that in each case the set of weights with 
respect to B x H corresponding to these functions is linearly independent. 

Let M be the open subset of G given hj A ^ 0, W ^ 0, D ^ 0, ^ 0, 6 ^ and 
suppose (P, Q) G M. Acting by H2 we transform (P, Q) to a pair (P', Q') such that the 
lower right 2x2 block of P' and the lower 2x2 block of Q' are 

(0 





WA\ 


* 


D 


D 


« ) 


A 
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respectively. Then acting by U2 (Lemma HD we transform Q' to a matrix Q" where 



Q" 



\ 





A 







D 




WA 







D 


D 









A 



Q" 



D 
A 



D 

V 



1. 



(The dots stand for zero entries.) We now turn to the matrix P' . Firstly, acting by Ui 
we make all the entries in the last two columns equal to zero except for the two on the 
diagonal of the lower 2x2 block. (These entries are 1 and A.) Acting by Hi on the 
obtained matrix, we transform the block corresponding to the last n — 2 rows and first 



n 



2 columns to the form diag(l, . . . , 1, 5). 



the new matrix to the form (for n ^ 5, 



n 



After that, again acting by f/i, we transform 
4, n = 3, respectively) 



(5) 








4 







. 


A5 


D 








1 . 














. 


1 





1 










5 





Ay 







A5 
1 

V 



_ 5 

$2 
15 


5 











1 








/i 

A 

15 







1 






A/ 



.,1,5) 
by P" 



(The lower left {2n — 2) x (2n — 2) block of the first matrix is equal to diag(l, .... 
and the remaining dots stand for zero entries.) We denote the resulting matrix ([5 
in each of the cases n ^ 5, n = 4, n = 3. 

The pair [P", Q") is the canonical form of the pair (P, Q). Thus the section is obtained 
Therefore the desired algebra A is contained in the algebra 

^A D WA 



(6) A 



D 



A ' D 

for n ^ 4 and in the algebra 

^A D WA 



$1 $2 5 
^'^'A5'D'$; 



c 



A,iy,D,$i,$2,5,^,-^ 



1 



(7) 



A = C 



D'A' D 



$9 



1 

A 



c 



A,iy,A$2,5,- 



1 

15 



for n = 3. 

We now apply Theorem[7]to the set of functions A, $1, 5, $2, W (the last is present 
for m ^ 2) for n ^ 4 and A, D, 5, $2, W (the last is present for m ^ 2) for n = 3. We 
have already seen that condition a) holds. Condition b) follows from the inclusions 
and dZD. 

Further we use assertion 1) of Theorem [71 First, we note that the weights of A, 
(for m ^ 2), S admit no representation of the form Q. Hence, these three functions are 
irreducible in A. Every representation of the weight of D in the form ([3]) has the form 
(7r„_i, axo) + (v^i, bxo) where a, 6 G Z and a + b = 1. Every representation of the weight 
of $1 in the form ([3]) has the form (tti, axo) + (^Tn-i, ^Xo) where a,b & Z and a + b = 0. 
Every representation of the weight of $2 in the form ([3]) has the form (tti, axo) + (v^i, bxo) 
where a,b E Z and a + b = —1. We now distinguish two possibilities: n ^ 4 and n = 3. 
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At first, suppose n ^ 4. Then it is easy to see that none of the weights of the form 
(7ri,PXo), (7i"„-i,gXo), (v5i,'^Xo), where p,q,r e Z, lies in the set 

Z = ((vr„_2, 2xo), (TTn-i + ^1, Xo), (tti + vr„_i, 0), (vra, -2xo)) 
+ ^((Tri + (fi, -Xo), (v^2,0)). 

Therefore the functions D, $i, $2 are also irreducible in A. Thus we have checked 
the hypothesis of assertion 3) of Theorem [TJ hence the functions A, D, $1, 6, $2? W 
(m ^ 2) generate the algebra A and their weights with respect to B x H generate the 
semigroup V{G/H). 

Now suppose n = 3. We shall prove that the function D is irreducible using assertion 1) 
of Theorem [71 Assume that there are integers a, h such that a + 6 = 1 and both weights 
(7r2, axo), (v^i, feXo) lie in the set 

Z = ((vTi, 2xo), (vr2 + (fi, Xo)) + S{{7T2, -2xo), {t^i + ^1, -Xo), (<^2, 0)). 
Then it is not hard to show that 

(7r2, axo) = P(7ri, 2xo) + p{.T^2 + V'l, Xo) + (1 - p){.t^2, -2xo) - p(7ri + v?!, -Xo), 
(V^i, &Xo) = -g(7ri, 2xo) + (1 - g)(7i"2 + V^i, Xo) + - l)(7r2, -2xo) 
+ g(7ri + -Xo) 

for some integers p, q. At that, 1— p ^ 0, —p ^ 0, g— 1 ^ 0, g ^ 0, whence p ^ and g ^ 1. 
Next, we have a = Qp — 2 and h = —6q + 3. Since a + 6 = 1, it follows that p = q. This 
contradicts the inequalities p ^ and q ^ I, thus the function D is irreducible in A. Now 
let us show that the function $2 satisfies the hypothesis of assertion 2) of Theorem[71 First, 
arguing as for the weight of D we obtain that {ni + (pi, — Xo) = (tti, 2xo) + (v^i, — 3xo) is the 
unique representation of the weight of $2 in the form ([3]) such that both summands lie in Z. 
At that, (7ri,2xo) is the weight of A. Second, we consider the matrices P = —F3 G SL3 
and Q = e Spa^. We have A(P, Q) = 0, $2(-P, Q) = -1 7^ 0, whence $2 is not 
divisible by A. Therefore $2 is irreducible. Hence by assertion 3) of Theorem [7] the 
functions A, D, 6, $2, W {m ^ 2) generate the algebra A and their weights with respect 
to B X H generate the semigroup V{G/H). 

Case 5. G = Sp2„ x Sp2m,,-f^ = Hq = Sp2„_2 ^ Sp2 x Sp2m,-2, ^(-^) = 0- The factor 
Sp2n-2 of H is embedded in the factor Sp2n of G as the central (2n — 2) x {2n — 2) block. 
Similarly the factor Sp2m^_2 is embedded in the factor Sp2m as the central (2m— 2) x (2m— 2) 
block. The factor Sp2 of H is diagonally embedded in G as the 2x2 block in the first 
and last rows and columns in both factors of G. 

We are interested in functions /(P, Q) G C[G] such that 

for all matrices P G Gi, Q G G2, Ui G Ui, U2 G f/2, hi G Hi, i = 1,2, 3. Suppose P = (pij), 

Q = (qij)- 

Theorem [6] allows us not to consider the actions of Hi and H^ and to reduce to canonical 
form only the first and last columns of P and Q. 

We introduce the functions A = P2n~l,lP2n,2n - P2n-l,2nP2n,l, S = q2m-l,iq2m,2m - 

q2m-i,2mq2m,i, D = P2n,iq2m,2m - P2n,2mq2m,i- We havc A = 1 for n = 1 and (5 = 1 
for m = 1. It is clear that A, S, D lie in A and are weight functions with respect to 
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B X H. Their weights are equal to tt2 (n ^ 2), {fn ^ '^), tti + fi, respectively. Below 
we shall apply Theorem [7] to these functions. 

We consider the open subset M G G determined by the conditions A^O, 6 ^ 0, D ^ 0. 
Suppose (P, Q) G M. 

Acting by H2 we transform (P, Q) to a pair (P', Q') such that the lower 2x2 blocks of 
the matrices P' and Q' are 



A 



D 

'a 



6A\ 
15 

V 



respectively. Then, acting hj Ui 
respectively, where 



P" 



(0 


o\ 





-1 


1 





^0 





and U2 (Lemma S]) we transform P', Q' to P", Q", 
( 



Q" 







D 



— 
D 

'a 



6A 
D 




for n, m ^ 2. In these matrices the dots stand for zero entries. If n = 1 or m = 1 then 



P" = p" 



Q" = Q" 



( 



\ 





D 

A 



D 

V 



respectively. 

The pair (P", Q") is the canonical form of the pair (P, Q). Thus the section is obtained, 
therefore the desired algebra A is contained in the algebra 



A = C 



A 



A 
D 



D 
A 



6A 



c C 



A,5,D 



1 1 
A ' D 
n ^ 2), 5 



By assertions 1), 3) of Theorem [TJ the functions A (n ^ 2), 5 (m ^ 2), D are irre- 
ducible and generate the algebra A and their weights with respect to B x H generate the 
semigroup V{G/H). 

Case 6. G = Sp2„ x Sp4, H = Hq = Sp2„_4 x Sp4, X{H) = 0. The first factor of H 
is embedded in the first factor of G as the central (2n — 4) x (2n — 4) block; the second 
factor of H is diagonally embedded in G, as the 4x4 block in rows and columns nos. 1, 
2, 2n — 1, 2n in the first factor. 

We are interested in functions /(P, Q) G C[G] such that 

f{P,Q) = f{u^'Phh2,U2'Qh2) 

for all matrices P G Gi, Q G G2, Ui G f/i, U2 G U2, hi G Hi, h2 G H2. 

Suppose (P, Q) G G is an arbitrary pair of matrices, the set M will be chosen later. 
Let us reduce this pair to canonical form. First of all, we put h2 = Q~^U2 and thereby 
transform Q to the identity matrix E/^. Now the problem is reduced to finding a canonical 
form for the matrix PQ~^ G Sp2„ with respect to the right action of Ui and left actions 



of U2, Hi. For short, we put PQ = R. Suppose R 



By Theorem [6] we do not 
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consider anymore the action of Hi and restrict ourselves to the problem of reducing only 
the first two and the last two columns of R to canonical form. 

We denote by Aj, i = 1,2,3,4, the minor of R corresponding to the last i rows and 
first i columns. Let $ be the minor of order 3 of i? corresponding to the last three rows 

and columns 1, 2, 4. Next, we put D = r2n,ir2n-l,2n - '^2n-l,l'"2n,2n + r2n,2r2n-l,2n-l - 

^2n-i,2^2n,2n-ii F = Ai$ + r2n,2^3- Bclow wc shall find out that A4 = —D for n = 3. 
The functions Ai, A2, A3, A4, D, and F lie in A and are weight functions with respect 
to B X H. Their weights are equal to tti + (pi, tt2 + ^P2, 7i"3 + V'l, t^a {n ^ 4), tt2, and 
TTi + TTs + ip2, respectively. Below we shall apply Theorem [7]to the functions Ai, A2, A3, 
A4, D, F for n ^ 4 and functions Ai, A2, A3, D, F for n = 3. 

The following argument will first be performed for n ^ A. We shall reduce the matrix R 
to canonical form on the open subset M G G where Aj 7^ for i = 1,2, 3, 4. 

Using the left action of f/i by matrices of type ([T]) we transform i? to a matrix R' such 
that all the non-zero elements of the lower half of the matrix R' are concentrated in its 
lower 4x4 block which has the form 










A2 

'Ai 

n 





A3 
A2 

r2 



A4\ 

"A3 



, ^2n,1^2n-l,2n.-l ~ ''"2n-l,1^2n,2n-l 

where = r2n,2, r2 = r2n,2n-i, rs = r2n,2n, = , 



Ai 



f2n,l''"2n-l,2n ~ ^2n-l,l^2n,2n ^ 
, ^^6 - — 



Ai ' " A2 

Multiplying R' on the right by an appropriate matrix in U2 of type ([1]) and then by an 

appropriate matrix in U2 of type ([2]) we successively obtain two matrices R'^ and R'2 such 

that the lower 4x4 blocks of R!^ and i?2 



v 








Ai 






A2 

Ai 






A3 
A2 

^2 



re 

+ 



A4 \ 

A3 


/o 


riAa 




A1A2 









Ai 





rir2 




A, / 






A2 

"Ai 






A3 
A2 






_A4\ 

A3 
F 

A1A2 
D 

A^ 
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respectively. Further, acting on the left by matrices in Ui of type ([2]) we transform R'2 to 
a matrix R" where 



R" 



/o 








VAi 










A2 







Ai 
A2 




A3 
A2 






Ai 

D 
A^ 

JA4 

A3 
F 

A1A2 
D 



Ai 




(The dots stand for zero entries.) The pair {R",E^ is the canonical form of the original 
pair (P, Q). Thus the section is obtained. Therefore the desired algebra A is contained in 
the algebra 



A = C 
C C 



Ai 



A2 A3 A4 F D Ai 1 " 

aI ' A^ ' A;^ ' aT ' A1A2 ' A;^ ' A^ ' at 



Ai,A2,A3,A4,Z^,F, 



Ai ' Ao ' A3 



By assertions 1), 3) of Theorem [7] all the functions Ai, A2, A3, A4, F are irreducible 
and generate A and their weights generate the semigroup T{G/H). 

For n = 3 a matrix R in the open subset M = {Ai 7^ 0, A2 7^ 0, A3 7^ 0} C G can 
similarly be transformed to a new matrix R' where 



R' 










VA, 









1 \ 


Ai 




Ai 






D 




A2 










A^ 





A3 


F 






A2 


A1A2 


A2 





D 


Ai 


aT 








/ 
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From this it follows that A4 = —D. The pair (i?', is the canonical form of the original 
pair {P,Q). Thus the section is obtained. Therefore 



By assertions 1), 3) of Theorem [7] all the functions Ai, A2, A3, D, F are irreducible and 
generate the algebra A and their weights generate the semigroup T{G/H). 

Case 7. G = Sp^n x Spa™ x Sp^i, H = Hq = Sp2„„2 x Sp2„_2 x Sp2i_2 x Sps, X{H) = 
0. The first three factors of H are embedded in the corresponding factors of G as the 
central blocks of the appropriate size. The factor Sp2 of H is diagonally embedded in G 
as the 2x2 block in the first and last rows and columns of each factor. 

We search for functions f{P, Q,R) € C[G] such that 



for all P e Gi, Q e G2, R e G3, Ui e Ui, i = 1,2,3, hj e Hj, j = 1,2,3,4. Based on 
Theorem [6l we may discard the actions of the first three factors of H and reduce only 
the first and last columns of P, Q, R to canonical form. Suppose P = {pij), Q = {qij), 
R = {n,). 

Let us introduce the following functions: Ai = P2n-i,iP2n,2n - P2n-i,2nP2n,i, ^2 = 

Q'2m-l,lQ'2m,2m ~Q'2m-l,2m92m,l; ^3 = f 21-1,1^21,21 — f 21 -1,21^21, 1 j — P2n,l<i2m,2m~ P2n,2nQ.2m,lj 
F>2 = q2m,ir2l,2l - q2m,2mr2l,l, ^3 = P2n,1^2Z,2i " P2n,2n'^2Z,l- ^ = 1 (resp. m = 1, / = 1) 

then Ai = 1 (resp. A2 = 1, A3 = 1). All the functions Ai, A2, A3, Di, D2, -D3 lie in A 
and are weight functions with respect to B xH. Their weights are 112 (n ^ 2), (f2 ('^ ^ 2), 
ijj2 [l ^ 2), TTi + (fi+ipi, TTi + ipi, respectively. Below we shall apply Theorem [7] to 
these functions. 

We consider the open subset M gG determined by the conditions 0, A27^ 0, A37^ 0, 
Di 7^ 0, -D3 7^ 0. Acting on the triple (P, Q,R) & M by an appropriate matrix in H4 we 
obtain a new triple (P', Q', R') such that the lower 2x2 blocks of P', Q', R' have the 
form 





CC Ai,A2,A3,A4,P',P, — , — ,— 



f{P,Q,R) = f{u^^PhiK,u:2 Qh2K,u^^Rh^K) 




( 



AsAiX 



\ A 







/ r2l-\,\V2n,2n — 2l-l,2lP2n,l 



{^2l-l,l<l2m,2m ~ 1^2l-l,2lQ2m,l) 



Ai 
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respectively. Now acting by U (Lemma H]) we transform the triple {P',Q',R') to a triple 
(P", Q", R") where for n, m, / ^ 2 



P" 



(0 


o\ 





-1 


1 





^0 





1^1 







A2A1 



V Ai 



R" 



J 



( 




^3 

V"aT 



Ai ^ 


A1A3 



^3 

D2A1 



(The dots stand for zero entries.) In the cases n = l,m = l,/ = lwe have 

Q" = 



p" 



1 
1 





\ Ai 



Ai \ 

1^3 

D2A1 



respectively. The triple (P", Q" , R") is the canonical form of the original triple (P, Q, R). 
Thus the section is obtained. Therefore the algebra A is contained in the algebra 



A = C 



C 



Ai 



Ai A2A1 Di Ai 
Ai'Z^3 



A1A3 D3 D2A1 



D3 
1 1 

aT'^ 



1 



By assertions 1), 3) of Theorem [7] the functions Ai (n ^ 2), A2 (m ^ 2), A3 (/ ^ 2), Di, 
D2, -D3 are irreducible and generate A and their weights generate the semigroup T{G/H). 

Case 8. G = Sp2„ x Sp4 x Sp2„, H = Hq = Sp2„_2 x Sp2 x Sp2 x Sp2^_2, X(i^) = 0. 
The subgroup H is embedded in G as follows. The factor Hi is embedded in Gi as the 
central (2n — 2) x (2ri — 2) block. The factor H^^ is similarly embedded in G3. The factor H2 
is diagonally embedded in Gi and G2 as the 2x2 block in the first and last rows and 
columns. The factor H3 is diagonally embedded in G2 and G3, as the central 2x2 block 
in G2 and as the 2x2 block in the first and last rows and columns in G3. 

We are interested in those functions f[P,Q,R) G C[G] that satisfy f{P,Q,R) = 
f{ui'^Phih2,U2^Qh2h3,U3^Rh3h4) for all P e Gi, Q e G2, R e G3, Ui e Ui, i = 1,2,3, 
hj G Hj, j = 1, 2, 3, 4. Suppose P = (pij), Q = (qij), R = {'T'ij)- Using Theorem [6] we may 
discard the actions of Hi and and reduce only the first and last columns of P, R to 
canonical form. 

We introduce the following functions: Ai = ^31544 — g34g4i, A2 = q32l43 — 1331^2, 

^1 = P2n,lQA4 ~ P2n,2n<iili ^2 = '^2m,l<li3 ~ '^2m,2m<l42i Di = P2n-l,lP2n,2n " P2n-l,2nP2n,li 
D2 = 21X1-1,1^21X1, 2m — '^2m-l,2m^2m.,l^ A = 52(P2n,lQ'34 ~ P2n,2n<l3l) ~ '^l('"2m,lfe ^ ^2m,2m<l32) ■ 

We have Di = 1 for n = 1, D2 = 1 for m = 1. Since the last two columns of Q are 
skew-orthogonal, it follows that A2 = — Ai. The functions Ai, 52, -Di, -D2, A lie in A 
and are weight functions with respect to P x if, their weights are (/92, Vi + <y9i, Lfi + %pi, 
712 {n ^ 2), ip2 {fn ^ 2), vri + <^2 + V^i, respectively. Below we shall apply Theorem [7] to 
these functions. 
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Suppose M C G is the open subset determined by the conditions Ai 7^ 0, (5i 7^ 0, 
§2 7^ 0, -Di 7^ 0, D2 7^ 0. Suppose (P, Q, R) G M. Acting on this triple by appropriate 
matrices in H2 and we obtain a new triple of matrices {P', Q', R') where the matrix Q' 
and the lower 2x2 blocks of the matrices P', R' have the form 



/* 

* 

1 

Vo 



1 




* 



{r2r 



.ife ~ ^ 2m,2m<l32)-r- 
O2 

A2 



(P2n,l934 -P2n,2ng3l)-^ 
Ol 



Ai 



^2A2 \ 





* * 

VAi W Va2 W 

respectively. Next, acting by U we transform the triple (P', Q', P') to a triple (P", Q", P") 
where for n ^ 2 and m > 2 



P" 





VAi 



_Ai \ 


DiAi 
5i 



^ 



Ai 


1 

V 





1 




A 

8182 
-1 



A2 



A 



AiA 

8182 
Ai / 



R" 





\A2 



_A2 \ 

82 



i^Va, 



82 




(For the matrices P', P' this is possible by Lemma |H) In these matrices the dots stand 
for zero entries. If n = 1 or m = 1, then 



P" = p" 



- 



VAi 



81 







p" = p" 



\A2 



A2\ 

'52 



respectively. The triple {P",Q",R") is the canonical form of the triple {P,Q,R). Thus 
the section is obtained. Therefore there is an inclusion 

"Ai PiiAi 81 Ai D2A1 82 I A AiA 
Ai ' (^2 ' 82 ' Ai ' Ai ' 5i52 ' 8182 



AcA = C 



C 



. 5i 5i 

1 11' 

Ai, 5i, (52, Di, P)2, A, — , — , — 
Ai di (32 



,Ai 



By assertion 1) of Theorem [7] the functions Ai, 81, 82, -Di {n ^ 2), D2 {m ^ 2) are 
irreducible. Let us prove that A is also irreducible using assertion 2) of Theorem [71 It 
is not hard to prove that vti + (y92 + = (vti + ipi) + 1^2 is the unique representation of 
the weight of A in the form ^ such that both summands lie in Z. At that, ip2 is the 
weight of Ai. Consider the matrices P = P2nj Q = ^4, R = p2m- We have (P, Q, P) G G, 
Ai(P,Q,P) = 0, A(P,Q,P) = -1 7^ 0, whence A is not divisible by Ai. Thus A is 
irreducible. By assertion 3) of Theorem [TJ the functions Ai, 81, 82, Di {n ^ 2), D2 
(m ^ 2), A generate the algebra A and their weights generate the semigroup T{G/H). 
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